DOCOSEHT REiSOHE 



ED 201 729 



CE 023 1B5 



ROTHOE 
TITLE 

INSTITOTION 

SP.ONS AGENCY 
POB DATE 
NOTE 

AVAILABLE, FROM 



EDRS PRICE 
DESCRIPTORS 



Bant a, > Trudy W.; Boser, Judith A. 

Evaluation of Tennessee's State Plan for Career 

Education K^|979-B0. 

Tennessee Oniv . , Knoxville. Bureau of Educational 
Research and Services , 

Tennessee State Deptl of , Education/ Nashville, 
Feb B^l 

90p.; Best copy available. Not ; available ia paper 
copy due to print quality. 

Bureau of Educational Research ^and . Services, 
University of Tennessee, 2046 Terrace Ave,,- 
Knoxville, TN 37916 (write for price) . 




IDENTIFIERS 



MF01 Plus Postage. PC Not Available fr^m EDRS, 
Advisory Committees; *Careqr Education ;\Inservice 
Education; ♦Needs Assessment; Program Administration: 
♦Program Effectiveness; Program Evaluation; Social 
Bias; Social Discrimination; Staff Development; 
♦State Programs; ♦Statewide Planning; Technical 
Ass/istcince; ♦Workshops 
♦Tennessee ' 



ABSTRACT 

■ This report presents an evaluation of the career 
education leadership activities conducted in Tennessee xn 1979-aO, 
the first year of operation for Tennessee's five-year State Plan for 
Career Education. Section 1 addresses the relationship between the 
activities in the State Plan andj a i^tate-wide needs assessment. 
Sections 2-7 focus. on assessment! of the six elements of the State 
Plan': (1) administration/coofdinationv activities of state 
coordinator, (2) advisory council, (3) technical assistance 
workshops, {«) workshop to reduce J)iasj and stereotyping, (5) 
counselor workshops, and (6) sunlme(r career education festival. Final 
reports from twenty local- pro jects funjied under provisi*^ons of the 
Career Education Incentive Act (P'.L* 95-207) are summarized,, in 
Section 8.. Findings are organized under these .headings: prior needs 
assessment data, project organization and support, ^ needs assessment 
conducted 1979-80, staff develop/ment, other project activities, ; 
project evaluations, funding, and \expenditures, recommendations for 
the state- wide leadership effort,\and achievement of state 
objectives. Section 9 summarizes major findings and recommendations. 
Suggestions a-re offered in the areas of objectives, involvement of . 
teacher preparatory institutions, a^dvisory council functioning, 
evaluation, -project selection, ajid proposal guidelines. (Twenty-three 
tables' and listings of responses display results of the various 
evaluations^ ) (YLB) * . . 
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SECTION 1 
INTRODUCTTON 

In the final month of operation for Tennessee's »79~80 or 
Career Education, the Bureau of Educational. Research .nd Serv th "Jni- 
versity of Tennessee,. Knoxrllle was awarded a contract by^hi: ^ .^se De- 
pa rtnu-n t. :if^E"dTrc at ioji. to ccmduct an cxternnl evaluat : of fh : :) 
:!f*tiv!U< s carried on-' mi .support oi i he Since Pla;i . 

• nngrue^r^cc Betwfon 'dentified Needs and State UDjecri 

In the year prior to the writing oL the ^1979-80 State P- ^iie- c:;^^j.u~. . 

ation director conducted a state-wide needs assessment whi icad :i 

mail survey of a stratified random sample ofJTennessee ^ s sup. t den. 0:3 , 

principals, teachers and community leaders. ' Both school per L and 

community leaders provided a strong indication that they con 1 ca-^^er , 

education goals to be compatible with" their own ideas about ■ -loul^ be 
going on in the State's schools, 

\^en superintendents, principals, teachers and commun:.^ " jirs were 

pres^ented with a set of career education goals and objectiv iidents 

"'and asked how much emphasis^ each .should be given in the cur 01 the 
local schools, an average of 96 percent of all respondents tall the 
objectives deserved "some'' or "much" emphasis. No group wa . s-^tis- 
fied with the extent to which the student objectives were b :^ili!^vr:d in 
the" schools, however'. Community leaders were least satisfi- '.te ex- 
tent of achievement, but even among school staff 20 percent 'i -relt the ^ 
career education objectives should be given more emphasis t chnols 

•were achieving. Responses of superintendents, principals a ers indi- 
cated that, at most 60 percent of Tennessee's schools had at ■ . c.t imple- 
meii't career ed,ucation in' some way;i and according to princlp r.pc-^ding to 
the survey, only 20 percent had formal programs for Infusin er education 
into the total curriculum. 

Survey respondents indicated that the chief obstacle t emc^ntation of 

career education programs was lack of funds. Lack of curri ~ materials and 

resources for staff traininp,, were other critical problems. asked what 

actions tlie State Department of Education could undertake t edite career 

education implementation, all groups of respondents gave tc i.^rity to the 

provision of curriculum materials and staff training in car t.^' lucntion. 

Federal funds allocated to Tennessee under the provislrr 93-207 . 

have helped to alleviate the principal career education neeiv 1- Lified by 
survey respondents. The following objectives contained in ne„: ^79-80 State 

Plan, pro-vide clear evidence that the critical needs for stnfr' t ining and 

provision of curriculum .materials have been addressed by deve loj. -.s of the plan: 

Goal A 

Objective 2,4 Provision of staff development activity 3 for 
Central Office Personnel. 

Objective 2.5 Identification of consultants capable o 5 pro- 
viding staff development for LEAs. 

yhjoctivo 1?. t> Dissemination to LEAs of a listing of such 
. ' t"onsul\\nnts/ • • 
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Goal . • . ' 

bj~:£c:._ive 1.1 Condirzt of in-ser^'ice institutes for LEA 
perSLr:Tiel . 

■;-"a:ctive 1.2 Cond\-:,r of trainir.g f :r local career educa- 
tion coordinatrors - 

;tjs:ctive 1.5 . Conduce of a state --^uzzut leadership conference. 

V-active 1.6 Conducr- of a Htate-w±£?ir conferencie involving 
education, government, private suployers and 
communiiity agencies . " ' 

Tjiective 1.7 Conducr: of a state— A7ii:3 awa' -o -'s session for 

re^res=:3;tatives of "eacher " :.r ration programs. 

bjSi-tive 1.8 Ccnducir of regional, wo rks r^:/:: ^ - counselors. 

-Tjecrive 1.2 Provis:::on of awareness sersl^ :is for local boards . 
of education. 

^'bjairrive 2.4 Adoptixm or development Mtrrrer' curriculum • 

guides in basic skilLs. 
T:ijHctive 2.7 Establishment of career ecr. cation resource centers, 
bjective 3.2 Purchase of instruct ionil -nad career guidance 

materials'. 

Limitations 

Tii^ _i^ited time, (three months, following the^ last nionth of project . 
■■ .eraticu:. specified for the evaluation of leadersjhip activities handicapped 
: -^r eval'^ators in three ways: 

1) evaluation could not be considered external in the strictest, 
sease' since all data-gathering ^instruraents had been designed by 
cch=srs. There was no overall evaluation plan, so the fragments 
c~ data made available to the evaluatars ori/a, post hoc basis had * 

t be patched together to form a somerzmes f less than coherent pic- 
trj:re of , leadership activities during .1379-^0 . ' ^ 

2) T-xe: -evaluators were not able to attenr: a State Advisory Council 
iiLeering or visit a local project. ThL::5 the State Coordinator was 
rhe only person associated wi^h the p— :ject with whom the evalua- 
tors had f^ce-to-face contact. ' 

3) The evaluatbrs were not able to prov xT^ the State Coordinator with 
management information based on evalusrion findings- throughout the 
project year. ' 

The wisdom of designating only 15 percenr of a relatively small base 
allocation for state-wide leadership activitie^^ in a state as geographic- 
ally spread out as Tennessee is questionable, "^"he State Coordinator needed 
all of her limited leadership funds f6j« progranr^iing and' travel She is to 
be commend'ed for her efficiency in saving for i r-poses of funding an ex- 
ternal evaluation even the small amount which e-^irntually was awarded. 

Organization of Evaluation Repnrrt 

The evaluation report contains nine sections, fhefirst is an introduc- 
t:ion, the last a summary and list of^recomm^ndatinins./. Each of the seven inter- 
i/ening sections includes an assessment of one of !3ie; elements-^of the State Plan 

Section 2. Admipistration/Coordination Activities of State Coordinator 

Section 3. Advisory Council * . . ■ 

Section 4 . Technical Assistance Workshops 

Section 5. Bias/Stereotyping Workshop / ' . ■ 

Section 6. Counselor Workshops • ' 

Section 7. Career* Educatiori.Pestival '^ . * " * *. , • 

Section 8. Final Reports from Local Projenis , 



ADMINT5 



ion/coordinat: 



::tivtties of state 



.DINATOR 



Kvnl \mt : 
>rdinnt orV- 
■:ecl to Liie 
: :mimun icat ioii5::~ r 
In the aT2:3 c 
tnraiuation of czar 
f±nal ' report ^-rxa 



f the. accompl; • imcnt of some of the 
■r ivlties v;as ba: ?d primarily or spiel 
mors by the jordinator herself th^ 
jr 1 rough her f._nal report. 



:r.:e Career Educ.:, "ion 
::i information :p- 
:e:h verbal or tten 



admin iaJtrar±on and coordination frr trhe plianning ^nr- 

education ivithin the' State (Goal da^^s cited r: the 

.d: that-^: * ' . 



.the Stata F ^.m met the requirements of PL95-207 (Siibigoal Al) , 
.the State P "..ir had been implemented in accordance 7:±th State and 
ppdernl -^^v : " v ris fSiibgoal A?'^ v:irh rhe exceptic^ thnt the l j::r 
of consuLta. ':s wns not yet finnlizod for d IstribuLxon to IF, As ('tli 
was accfv-ip] i)' d doling .larmarv 1981. how.ever.^X., and \ 
.a time-^line pro ject activities had been developed (Subgoal A3 



In providir 
of career educa 
volvement of te 
(Subgoal Bl) . ' 
f ied: and appror 
revision -bf the 
; Several oc 
against which z 



leadership and , coordination for the awareness and promotion 
: witfiin the State (Goal B) , one activity was deferred — in- 
ler prepai;ation institutions in a one-day awareness session 
e Career Education Advisory Council was organized- as speci- 
acejy utilized in^ the development, implementation, and 
late Plan (Subgoal B2). t 
ctives included, in the State Plan specified a criterion 
judge .success of implementation. The criterion was , in most 
cases, the, persi-ntage of local pro-jects accomplishing the (j^bjectiue. The 
State Coordinat or 's review of 'local projects in her final report indicated 
that the crite-ion- level specified for 1979-80 was reached for all .criLerion- 
bascd admin istr:ation/roordinaL 1011 oh j ect Ives" (see Table 1). 

With respect to her administ raiion/cooVdxnation' object ives , the Career 
Education Coordinator * ef fortes met' or exceeded criteria set ^or her obje'ct- 
iVes in all except two activities — one of whidh was in progress at the end of 
the project year and the other of which had been initiated btit delayed, in ordei 
to achieve greater effectiveness. ^.The participation of local projects in 
•achieving the stated objectives reflected 'the extent to which the Coordinator 
made local project directors aware of the need -to exert their own energies to 
promote car^eip/^education . • 



L4BLE1 . 

ACCOmiSHMENT OE SIM COORDINATOR'S CRITERION- 
BASED ADMINISmTI0K/COOPJ)INATI(3 03JECTIVES 



nbjern'vp 



Per Cent of Projects Accomplishing fche Objective 

0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 



- Sent cepiesentative to 
workshop on bias/stereotyping A4 



S 



Sent' State Depaftinent the 
resillts of a local needs 
assesEnsnt ' Bl- 



Sent froiii the local Board of 
Education a policy statement 
or letter of support for Career 
Education to the State Depart- 
ment of Education CI 



J 



Had local plans reviewed by dis- 
trict team of Career Education 
Specialists ^ CI 



C2 



Provided training for part .or 
fuUtime career education co- 
ordinator employed by participating 
systei 



Developed a curriculum guide- in 
a basic skill area C2 
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SECTION '3 



y\' ADVISORY COUNCIL 

— ^Th^ establishment *ind operation of the Stale Advisory Connci I w'.m-c 

responsibilities of the State Carc3cr Education Coordinator, How, wIkmi , anu 
if - the Council functioned were at tlio discretion of the Coordinator.^ The 
stated role of the Advisory Council in Tennessee was to provide "advice and 
assistance to the State Coordinator on matters related to management cind im- 
plementation of the Stnte Plan for Career Education.'* 

'I'he Coordinator reflated impressions about the functioning of the Si.aLo 
Advisory Council, hut it- was felt by the evaluators that views of die Council 
members themselves should be obtained. Wliile it would have been preferable 
to\meet with the Council members to determine their perceptions of the func- 
tioning of the Council, this was hot possible due' to financial limitations 
and to the fact that the Council was not scheduled to meet prior to the time 
the evaluation was to jbe completed, ' laformatlon was obtained from State Ad- 
visory Council members by means of * a survey conducted by mail irj December 1980. 

Replies were rece^ived from 19 of tlie 24 Advisory Council members. Table 2 
contains a summary of rnombers ' responses. Council members indicated that in 
general the State Coordinator's- objectives had been met. Council members, al- 
most without exception ,y supported the stated role of the State Advisory Council 
and felt that it accur^^tely * described., t he role they had played during 1979-80, 

In addition to rcvie:wing proposals. Council members actively participated 
in developing goals and objectives, establishing jtime lines, making decisions, 
and reviewing and revising the St^te Plan (84% or more of those respond^ing in- 
dicated such involvement.,). Ten of 17 (59%) resjiondents reported that bhey had* 
been actively involved ia^ disseminating the State Plan to local educations agen- 
cies, /while 10 of 18 Council members responding (56%) reported having acti\;ely 
participated in publici\'ing career education activities on a local or regional 
basis. " \ \ I ■ \ 

The mean effectiveness rating given the Advisory Council by the members \ 
was 7.7 on a 9-point scale, with 9 defined as "Very Effective", 5 as "Ineffect-'^ 
ive", and 1 as "Detrimental". 

Council members expressed positive assessments of the guidelines used for 
reviewiilg proposals (mean==6,6 on a 9-point scale where 9="Very Good" , 5="Ade- 
quate", and l="Very Poor"). The State Coordinator indicated that some dis- 
satisfaction had been expressed and that efforts to revise ^he guidelines had 
already been undertaken. ' 

Comments on the survey form indicated that in general Advisory Council 
members endorsed the way in which the Council functioned during 1979-80. Two 
suggestions, each of which was offered by more than one person, were- for 
regional meetings and for more meetings and/or more time to meet (Item j.0). 

The members of the Advisory Council seemed to feel that they had been 
effective in fulfilling Jthe role a^sslgned to them and that the: role v;as the 
appropriate r)no for the vState Advisory Council. Few changes were suggested. • 

Jn most respects die State Advisory Council functioning was consistent 
with the relevant Subgoalj^j (A3 and b2) and often exceeded the criteri5h^'--levels ' 
which .had' been established; Subgoal\ B2 was specific with reference to var;ious 
functions of the Advisory Council, J'^embers reported that the Council did.v-' 
function I'n 'accordance with the stated objectives. Although 65% participation 
in .reviewing proposals Was the criterion, 1,8 of the 19 responding (94%> reported 
being involved in this acirivlty, Ten\of 18 publicized care^er education activi- 
ties on a regional basis, greatly exceeding the three-member criterion. Ten of 
17 Council members participated in the\dissemination of the State Plan to LEAs 
(there was no stated percentage* of Council members set as a" criterion for this - 
activity). . . ..' *, ; ,; xSl ■ ■' ' . 



In summary, the State Coordinator established and operg^^ an effective 
Advisory Council during 1979-80. The Advisory Councilpe^ershij) h only 
one recommendation for improvement:. , More Adviso;ry^,,£dtocil meetings. If funds 
could' be committed, more* Council meejtings^ shoyi^^^ held in 1980-81', 

c 
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TA3LE 2 . ■ ' 
RESPONSiiS TO. ADVISORY COUNCIL SURVEY 

' , ' ■ ■ ' ' : 

ITEM 



the 
ass 



The Tennessee /Coordinator of Career Education, Mrs. Sadie Chandler, has do Fined 
role of the Career Edu(jatio,n Advisory Council as one of providing ''advice and 
istaiice to the State Coordinator on matters relat/id to managfeTnent and implementation 
the State, Plan for Career Education." ' 
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As a member of the Career Education Advisory . Council, 
do'^^ou agree that this should be the role of the Advisory 
Council for Career Education in Tennessee? 

If . not , >please describe the role you think the Advisory .. 
Council should play. 

This is' one role. In addi.tion, to advise the State 
Board of Education on the direction , etc . i of Career 
Education in Tennessee. 



DofBS Mrs. Chandler's statement accurately describ^ -the 
a ctual role of the Advisory Council during. 1979-80? 

If not, how has the role actually p] iiyed by the Advisory 
Council differed from that described above, by .sthe State 



Director, of Clarieer Ejducation? 



Plus screening proposals, . gave opinions and eyaluat\ion. 



;Did 'the Advisory Council ac tively participate in develop- 
ing goals for the Tennessee State Plan for Career - 
Education? ' i 



Did the Advisory Council actively participate in 
establishing timelines For the Jdenriessee Stnto^ Plan for 
Career Education? \ 



Did the Advi.sory Council art f voly ll^Xii.ii-^*l^-^^-^~^ 
semi na ting tlic State Plan to Mi As? 



Did the -Advisory 'Council actively participate in 
decision-making?' . ' 



dis- 



Yes 
18 



19 



19 



4. Did 'the Advisory Council actively participate in' develop-. 18 
ing ob{ljgctives for the Tennessee State Plan for Caree^r . . ^ * ; 
Education? . ' ' . \ 



16 



10 



Noi 
1 



Total 
19. 



19 



19 



19 



19 



17 
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TABLE 2 (contM) 



Yes 



No 



Total 



What kinds of decisions should have been made by someone 
else, in your opinion? ; ^ 

A panel of .readers should be utilized on project 
proposals rather than * advisory council members since 
some advisory qouncil-members submit proposals from 
their school .system. ^ ' ' , , 

This involvement seems at the correct level for 
decision-making. ' 

Only in an advisory capacity. 



8, : Did the Advisory, Council actively 'participate in. reviewing 
and revising;,,the^ State Plan for 1979r80.? 



16 



19 



9.. 



On a scale of /I to 9, rate the effectiveness of the Advisory 
Council (as a group) in, developing, implementing, land revising 
the 1979-80 /State Plan for Career Education in Tennessee. 



Rating 



Detrimental 

1 2-3 '4 



Ineffective Very Effective 
5 6 7 8 9, 



Number 



7 "11 



Mean=7 . 7 



LO. In what wayCs) could the effectiveness of the Advisory Council be improved 1 

Opportunity to meet more often and subcommittee meetings. 

' . ' Hearings could be. held on^ a regioiial basis by the council 

,^ ■ ' to determine r items of priority for career education. Findings 

, could be reported"^ to the State. Board and be included in the .: * . 

revisibh of the . State plan. 

■ . ■ ^ ■ ' -J- ■ - ' _ ' -• " 

J More time together. , ' 

■ . . I' . . ... ■ ' w - ^ ... ' . I' ■ 

Format to -^f ecognize >and help, expan^d efforts 'from all agencies. 

J Regional meetings ' , " - 

) DevBlpp a better instrument/^ to evaluate proposals 

/in the £uture, more involvement in the review of existing project 
evaluations in order ^to make better decisions on upcoming proposals 
V >^ and'-dissemination of funds. . v 

'""^ c' .^^-^ ■ . , / ■ ■ - . - ; ' .\ 

1 Possibly more time to meet so meetings would not need to be so long 
when we do meet. J ^ 

Members of Council work well and hard together in minimum . 
length of time 1 6 accomplish duties. . 
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TABLE 2 (cont'd) 



11* *Were you involved in reviewing proposals? 

How many proposals 5id you review? 

]L8 all submit te^d " ' - 

1 no ! \ 



12. How would you rate the guidelines for reviewing 



proposals? 


■ ■ , , Adeqijiate , 


•* 


* "Very Poor 


Very Good 


Rating 1 2 3 


'4 5 6-7 


8 .9 


Number' 1 


2 1 2 \ 7 


4 2 



Mean=6,6 



Yes 
18 



No 
1 



Total 
19 



13. Have you actively participated . in ^publicizing Career 
.'Education activities on a local or regional basis? 



10 



18 
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.-^ . ■ SKCTTON 4 ^ ■ ■ '-^ \ ' 

TKCHNICAL ASS I STANCli WORKSHOPS 

During 1979 three regional-technical assistance \^orkshops>wereN^ planned 
and conducted by the State Career Education Coordinator to provide an .over- 
view of carreer education for^LEAs and to assist . them in;:^'understanding "how , to 
develop a pro'posal fdr a local career education -project » 

' A total of 92 persons attended the three technical assistance workshop?.: 
29 iti" East Tennessee, 24 in Middle Tennessee , and 39', in West Tennessee/ Over 
47% /of the participants completed evaluation fo^ms at the conclusion of their 
workshop. 

The first 11 items on the e.Valuation form (See Table ...3) pertained to 
chara^cteristics of presenters/speakers, on which they were rated'^'as truly 
outstanding; superior;^ood; fair, average; below average; poor. Almost withr 
out exception, the majority %f participant responses to these items were posi-. 
tive. It should be noted that the rating categories provided greater diffeirr- 
entiation in the positiye direction than in the negative since\th three 
above-average, options and only one below-average option. 

Speakers/presenters were rated highest on knowledge of subject matter 

(Item .4)-i 'with 98% rating them as "superior" or "truly outstanding"; and ^ • 
lowest on. flexibility arid, responsiveness to problems and needs gf participants 
(Item 1), ©n which 36% rated them "good" or "fair." Respondents .generally 
viewed"the speakers/presenters as tol/erant, interested in subject matter, hav-. 
ing 'clear workshop objectives, agreeing between' object ives and what was dis- 
cussed, and keeping participants in^yolved. Eighty-three percent of the res- 
pondents' rat^d the' overall conduct /of workshop "superior" or "truly outstand- , 

■ -The second part of the evaluation form consisted of eight items that 
de<?erlbed aspects of the workshop other thari the speakers/presenters'. Responses 
to Items in this secLion also were generally positive, although both workshop,/ 
..facilities (I.tem.,17) and opportunity to interact with other wprkshop partic " 
pants (Item 13) were not marked positively by 30 ..percent of . the participants 

(See Table 3J.^ ■ ■ . ' / • ' ' ' " 

Item 21 (See'^"Responses to Item 21") asked respondents po list ., one or two 
things, done especially well .in the . workshop. The responses ^^can be classified 
in three general categories: workshop organization, content, and presenters. 
Workshop organization was\most frequently mentioned as one of the things done ■ 
well. Discussion of the proposal was specifically mentioned by eight people, 
the. handout' materials and iiwe of audiovisual materials^ by,., jour each. The 
i(U'cnuvsi-\ n!i('{ enthusiasm of the speaker?^, the State Coo^in/itor in |inrticular, 
were, also commended by t ho part i ci p.iirts . ♦ \/ ' 

j'or \liem 22 (See :."Kvspoose.s t.o 1 Ilmh 22") , "Comments Jr Suggestibns" , ' 
there wns \much less dupli'cat ion of. rejrypo.nses , Sonlie positive commei>ts reiter- * " 
ated those/given in response to Item 21, pnrticurarly with reference to the 
orgariizatic^n for the workshop itself. .Some suggestions fcould ,be applied to 
future projects (listing the site in advance publicity riotices , ^having shorter 
sessions;) while others were more relevant to the t:echni^cal a^^i^tT^nce workshop 
itself or to other workshops on the same topic; ^ V 

Since there was. not much duplication among* respon^fees ,to Item . 22 ^ there is. 
little indic^ation that many changes ^were desired by the participants . The 
responses to the whole evaluation instrument were^primarily positive"^ in nature 
and indicated participant approval of the way inVhich^the technical assistance-..; 
workshops were planned arid carried oiut. ' . .. . 
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"Through rxe technical assistance workshops, the State Department of 
Education prox^lded technical assistance for the development of career educa- 
tion program proposals which subsequently received financial assistance (Sub- 
goal CI), Perhaps more indicative of effectiveness than the positive tenor 
of the ratings given on the evaluation forms is the fact that of the eighteen 
workshop participants who developed and submitted proposals, all received 
funding. Three additional LEAs sought and received individual assistance 
■from^^the State Coordinator to develop proposals which also received funding, • 
The effba;:ts .of ^^the State Coordinator with respect to Subgoal CI were shown to 
be qilite effective since LEAs that participated in the workshops and later 
developed career education program proposals were successful in their. at- 
tempts to gain- funding. : ' , 
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TABLE "3 

PARTICIPANTS' RESPONSES TO EVALUATIVF/ QUESTIONS CONCERNING 
TEC11N1C/\L ASSISTANCE WORKSHOPS 



Truly ' ^ fair 
Outstanding Superioi;, Good Average 



Below 
Average 
Poor 



Missing 



Flexibility and 
responsiveness to 
\ probl^Qins and needs 
of participants. 



14% 



50% 



32% 



4% 



Tolerance: Par tic- 
ipants. feel free to 
ask questions. 



disagre'e^^ express 
their ideas, etc. 




45% 


■ 16% 


.5% 






3. Interest in" subj ect 


' • ' 












matter' of workshop " 
sessions. 


■ ■■■41% 


50% 


9% 






4. Knowledge of subject 














1 . matter;|of workshop 
j' sessions . . . 


48% 


50% 


2% 








5. Organized pre- * 














■ . sentation of \ 














materials and 
subject matter. 


32% 


:\ ■ 

■ . 50% 


16% 


2% 






6. Clarity of , 








■{ 






■ interpretations and ' 








■ '."1 






explanations ..of , 
subject matter. 


■ 23% 


57/: 


20% 








7. Emphasis on impor- 














tant mate,-p-ials am 
subj ect matter.. 


. 18% 


■ 68/. 


14% 








8.. Clarity of workshop . 
obj ectives . 


, 34% 


55% 


11% .,. 




•■J 




^' ^' ■ 

i9. Agreement between 














objectives of the 














1 workshop and what 














was actually dis^ 
^ cussed. 


32% 


50% 


18% 








keep me 














\involved in workshop 
jl r \earning act iy,i ties 


■ . ' 16% 


50% 


29% 






• " 5% 


ERIC' T?^*' ^'^^"^'^'^.^ . 
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TABLE 3 (Continued) 

V ■ 
(Response altcrnntlvcs connlsted of a aeries of faces 

with negative, neutral;, and positive exprc::DionG) 



Neutral 



Missing 



12. Opportunity to 
participate in 
active learning. 



2% 



14% 



52% 



32% 



13.'. Opportunity to 
interact with 
other workshop 
participants. 



2% 




23% 



.45% 



25% 



14. Opportunity in — 

interact with project 
staff. 



5% 



\\. 2% 



57% 



36% 



15. Advance information' 
about workshop . 



5%., 



14% 1 



45% 



34% 



2% 



16. Orientation during 
opiening sessions. 



\ 
\ 

\ 

9% 



\ . 
\ 



57% 



34% 



17. Workshop facilities. 



30% - 



38% 



32% 



19. Organizational 
details. 



2% 



2% 



64% 



32% 



20; Usefulness of 
^nf orpiation. 



2% 



5% 



45% 



48% 



N = 44 



\ 



id 



Responses to Item 21 

List or describe one or two things you thought were done especially well 
this workshop. 

Workshop Organization * " • - 

Organiz-ation and timing of workshop - 12* 
Handouts,, resource materials - 4 . . 

Films, audio-vi'suals - -4 

/'■••.' 

S^tructure and content 
Content < - 

^Introduction of many facets of Career Education (overview) ~ 6 
Definition of 'Career Education 

■ ~? ■ 

■ Explanation of: subject matter, forms - 3 
Walking through proposal format - 2 ' ^ ' . ^ 

Organization o-f application . - . 

. Technic'^1 data 

Specific information to include.. . , ' 

Discussion of proposal preparation - , ^. 

Explaining- state guide ' . - 

^' . Usefjul information ~ 3 " . ^ 

Typeis, of .projects that can -be funded 

! " « ■ . . » 

Sex stereotyping ' , 

is being done elsewhere / 
Not giving a definite amount of money, especially /to larger S:--st:3Tns 

\^ Gucslt speakers - 4 - 

ProspilLal ions - 3 . ' 

■ i ■ ■ * ' ' •■ , ■ • ' . 

Willingness of stafl" to answer aXI. questions ~ 2 . 




Wiat 



Presenters (continued) / 

' \ ■ • i .' 

Sadie^s presentation, enthusiasm -:2 

Attitude. of. presenters - 2 

Enthusiasm of staff - 2 " ^ . / 

' . ■ / 

' ^ ■ ■ - ' •■ ■ / 

Interest and ent,husiasm .of participants 



'^^The number of participants giving^ this response if-given by more than one person. 

■ ■ . •/■■-■■ ■ . ■ . 
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.Responses to Item 22 

List any comments or suggestions about workshop details. 
Positive comments 

Good overview ' 

Well, planned -to meet needs of those present 
J Well organized and presj^nted. 

Very positive 

Sadie's enthusiasm 

Good workshop 

Good meeting • . ' v 

Presentations , ^ 

.Too much lecture, needed probing questions asked of participants to gene^rate 

discussion and Interacts. on / ll 

'/ 

'More direct answers about questions concerning career education and how to 
•begin 

Do not read obj ectives^when . presented on overhead, give important, facts in 
own words 

Organization^ and Facilities ^ ^'^-'"ij . ^ 

More opportunity 'to interact with staff over proposal development 
More time to talk with -others in the group ' 
Shorter. -sessions - ^ , ' ^ ' 

Later starting time ; - 

. J.nvit:e practit Loner I'athor than only supervisors 

More sales rcpreseiuat' i vos- to rannliarizc panic i panls with existing career 

education materials . ' • • • 

Better parking . / . 

The buj-lding in which the workshop w^s to be. conducted should have been 
.included in Advance Information Announcement- / : 
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Content 

•The only new information was on project writing 
More. time on a more thorough study of the manual 

Unsure about 'needs and objectives in the application ' \ 
General ■ ' \ 

Amount of money suggested as a top limit caused our system to decide not to\ 
submit 

The amount of money for salaries to.put the plan together would exceed the 
' grant • ' " "^'^ ■ V- ' ' " 



Added personnel, neaded 



■J 
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SECTION 5 /. 

BIAS/STEREOTYIM NO WORKSHOP / - 

[.onclcrship the? stato level tf) sensitize project personnel cind to 
inilinte proj^.ress townrcl cl.imin;U inj> bins and sterootyp i n|^ b.-iscd' on r;jro, 
aj^e, sex, economic sLntus, f)and:ic;ip, nnd national origin was shown in rhe 
o.rganizaJ:ion of a stade-wide workshop. The workshop, entitled "Combating 
Sex, Age, Race and Handicap Bias/Stereotyping in Career. Education", was 
conducted April 8, 1980 in Nashville under the joint sponsorbhip of the 
Tennessee ^Department of Education and the American Institute for Research 
(AIR).. 

Twenty-three of 46 individuals in attendance at the. workshop completed 
an 18-item instrumen t ^ prepared by ATR personnel both at the beginning of the 
workshop and at its conclusion as part of ain effort to measure chainge in at- 
titudes. Tl^e original presentation of data from the evaluation instrument . 

^^ompilecJ by AIR (See Table 4) listed pretest item frequencies and means inde- 
pendent of post test item frequencies and means. The evaluators were ^-not given 
sufficient information to' determine whether the same 23 persons completed the 
instrument both times. , Even if thatWere the case, there was no. way. of match-, 
ing the responses of individuals given on the two occasions, which would have 

'resulted in a greater chance of detecting significant changes th^an was possible, 
when the two sets of data were considered to be. unrelated , Another factor which 
cannot be overlooked is that respondents completed the same instrument on both 
occasions. Having taken the pretest may well. have sensitized participants to 
items of content causing- them to attach greater importance to those items v/hen 
presented and to remember them on the posttest. 

The instrument consisted of five st atements , related to the disabled, 
five concerning s:ex differences, and four each focusing on the elderly and 
on racial differences. Each of the 18 items was rated on a five-point Mkert 
scale with l=^strongly^ disagree , 5=strongly agi;ee. The greatest. ' change in 

; rating was recorded on Item 4 ("There i"^ relatively ;iittle in the women's 
movement for men,"). From a pretest mean of 2.. 3, the posttest mean of 1.4 
showed almost .a full rating point- gain in the direction of greater disagree- 
ment. Item . 8 ("There is toodittle concert for- the mental health of the- 
elderly") increased by .80 from pretest to posttest,. while increases of .70 
were. found for each of three statements: Item 3("The main "point of the women's 
movement is ' t^o build trust and nkw kinds of partnerships among men and women"). 
Item 7 ("Educational opportunities are increasing for older people.".), ^nd 
Item 16 ("Schools still do not /of fer equal academic preparation to students of 
all, races.") . 

_^&PA3iCatij3n„Af--,staJj-stx and posttest scores (inde- 



pendent t-'t^ests) "for individual items showed significant changes for the five 
items previously lisJ:ed and /for Item 9 ("Older people are increasingly being 
seen as -capable workers") , /which evidenced an increase of ;. 60. 

Three of the four items related to the elderly manifested significant 
change, while none of the items related to bias' due to handicapping' conditions 
showed, significant char^ge.. Whether, thiS: is a reflection of the emphasis given 
the various topics dur/ing the .workshop or ^the extent of previous knowledge in 
the various areas, cannot be determined from. the results obtained by. adminis- 
tering this instrument. The summary of ins trument responses which was pro- 
vided to the^valua£ors by AIR included ho information regarding reliability ^ 
or validity of the^ instrument , so it must be assumed that neither had . been, 
established. / . - 

. ' 24'..- ■, . ■■ ■ 
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Information supplied by the State Coordinator indicated that 75% of 
the funded projects (l5/20) sent representatives to the bias/stereotyping 
workshop'^. This excer^ded the criterion- level of 60% stated in Subgoal A4 .. . 
for 1979-30. In tenuc of effectiveness, analysis of pretest-posttest scores 
indicated a tendency -toward reduction of bias and stereotyping behavior among 
participants, with the niost noticeable changes occurring in the areas of age 
and sex discrimination. ' 




TABLE /) (Continued) 



Disabled individuals tend to miss 
a lot of work. 

Disabled people. do not have equal 
lob^oppo'fuinitics. ■ 



Pretest^ ' 

■ Total 
n 1 2 3 ^ 5 V 



22 U 0, 0 1 1 1.6 



n - 1 1 2 11 6 3.8 



Race discrimination on the job' is\ 

less or a probiem than in the Rast\ 23 "2 3 5 10 3 3.4 



Schools sdll do not offer equal 
academic nrepaiaf-ion to students 
of all races. 



7 Race is still a factor iti career 



tracking of students, 



/ 



Schools have lessenS race stereo- 
typing substantially in recent years. 



23 4 4 7 11 2i9 



23 1 L 5 11 2 U 



23 ' O ,1. 6 l/i 2 3..7 



Posttest^ 

. ■ Total' 
n :.l 1 3 k /5 



21 U '2 2 0 0 1.3 



21 1 1 2 9 8 4.0' 



22 l 5 k I . k 3.3 



: 23 0 2 9 8 4 3.6 



22 1 1 5 12 3'' 3.7, 



23 1 2 ■ a 10 1 'U 



Dif'f. 



r.3 



+.2 



-.1 



+.7 



+.3 



-;3 



Respondents fated each item on a five-part scale; 1= -strongly disagree, 5= "strongly agree. 

b. ■■'^i ■ ■• ■ . \ ' ' ■ . . ■ 

. T.tHailed ■probabilities for independent t-test significant beyond ',05. ■ S ' ' 
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TABLE 4 (Continued) 



^Disabled individuals tend to miss 
a lot of work. 

♦ 

Disabled people do not have equal 
job opportunities. 



Race discrimination. on the job is 
less of a problem than in the past. 

Schools still dp not offer equal' 
J academic preparation to students 
t^ of all races. 

I . 

•Race is, still a factor in career 
tracking of students. 



Pretest^' "'■ ' 

Total 

n ' 1 !2 . 3 -i '5 x 




22 U 6 0 1 1 1.6 



22 2 . 1 2 11 6 3.8 



23' 2 3 5 10 3 3.4 



2] k k 1 1 I 2.9 



23 ^ /i 5 ,11 2 U 



Schools have lessened race stereo- 
typing substantially iniecent years'. 23 0 1 6 U 2 3.7 



„ Total ' 
n 1 2 3 ^ 5 X 



Diff. 



21 17 2 2 0 0 1.3 



21 1 1 2 9 8 '^.O 



-.3 



+.2 



22 2 5 ' r 7 t\ 3.3 



-.1 



23 .0 2 9 8 ^ 3.6 



22 1 1 5 12 3 3.7 



23 1.2 :8 10 2 3.4 



+.7 



+.3 



-.3 



^^Respondents^ rated each item on a five-part scale; 1= strongly disa^gree, 5= strongly agree. 
Two-tailed probabilities for independent' t-test significant beyond .05. 



'•^ " ■ SECTION "6 

\ . COUNSELOR WORKSHOPS 

\Three regional career-education workshops were sponsored for counselors 
by the State Department of Education in an .attempt to further develop their * 
knowledge about career education.*^ Attendance was 40 in M.iddle Tennessee on 
November 16, 19)9 at Murfr^esboro; 51 at Reelfoot Lake Park on November 16-17, 
1979 for East -Tennessee; and 52 at the West Tennessee workshop, which was. con- 
ducted February 15-16, 1980 at Maryville. Topics presented Lo the lA 3 coun- 
selors who attended the three workshops 'included sex equality, activities to 
eliminate stereotyping, and career education assessment and techniques. Al-^ 
though evaluation activities were conducted , no data were made available to 
the State Coordinator or to the evaluators. 

Evaluation might have provided some insight into the lack of attendance 
at the coun^.elor workshops. Since not all funds available to pay expenses ''for 
participants\\were expended, cost to participantSs.was 'not a likely cause for 
-lack of atterldance. In order to .detemiine -why the Coordinator's criterion 
level of participation by 25% of the State's approximately 1,000 counselors 
was not reach^d^, some type* of follow-up would have been necessary. Since 
this activity 'Was not to be continued in the State Plan, there seems little 
point in furth(^r investigation at this time. 



\ 
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■ ■ ' ■ ' SECTION 7 ' \ . . . 

. CAREER EDUCATION FESTIVAL , ' 
Introduction 

A state-wide leadership conference, the Career Education Festival, was 
organized and conducted by the State Career Education Coordinator to -provide 
irfformation about funded projects in the State; to inform cpnferees^about 
current developments in. career education on the national level; and to stim- 
ulate greater involvement of other LEAs, community agencies and professional 
organizations in career " education in Tennessee. 

The Career Education Festival was sponsored by the Tennessee Department 
of Education on July 15, 16, and 17> 1980 at Gatlinburg, Tennessee. One 
hundred and fifty persons attended. In additipn to speakers on general carreer 
education topics, 19 of the 20 funded state projects shared information about 
their projects. Three types of evaluation were utilized during the Career 
Education Festival: A "Pre-conference/Post-conference Assessment , individual 
mini-session rating forms, and evaluation of the general session speakers. 

Career Education Assessment 

Participants were asked to complete a checklist (the '*Pre-conference/ 
Post-conference Assessment") that contained ten items designed to indicate 
whejiher they felt they possessed, adequate or inadequate knowledge ^with refer- 
ence to* various workshop objectives. Nine people ' checked each item on both 
pre- and post-ponf erence bases, while an additional eight responded only in 
terms of pre-conf erence knowledge. ThoSe who checked pre- and post-conference 
knowledge did so on the -same form. The -total of 17 represents 11% of those 
attending, although it cannot be determined how many of the total of 150 were 
present throughout the Festival. , ""^"^"-^-t-^^^ 

According to the responses received, the greatest lack of inFonn'ation. _ 

before the conference was in knowing where career education projects were in 
operation in Tennessee (Item 8), on which IQ of the 17 participants felt their 
knowledge was inadequate (see Table 5). In contrast, only two people initially 
felt they' could not; adequately define career education (Item 1). Six of the 17 
felt they lacked sufficient knowledge, to use the Dictionary of Occupational 
T:itles as a reference to identify jobs (Item "3). Of the. ten items, only Items 
8 and 3 were checked by one-third or more pf the participants as those about 
which they had insufficient knowledge. If the ten items represented the . 
objectives of the Festival, the pte-conf erence data indicated that a different ^ 
audience might have gained more from the Festival than the one that attended „ 

Those who completed the Pre-conf erence Assessment represented yarious 
groups and, levels of knowledge. Among the participants who responded were three 
teachers, threk counselors, three project directors, three -state c[^P-^^tment em- 
ployees, two advisory council members, one l.ocnl educational agency representa- 
-tirve ^-one count:,y representative, cnul. one hig|icr education representative. Two 
of the project directors, two state department employees, and one advisory 
council member Lndicated that they felt they liad adequate knowledge on all . 
items before, the conference. The needs of the otiiers, by position, are pre- 
sented in Table 6. Although the numbers were" too small to be representative , 
information of tliis type would.be helpful in planning future conferences with 
regard to which :populations-ro~s'erve~^an^~wh'at~^ . * ^ 

On the Post-conference 'Assessment the only itern^; f or which all nine pair- 
ticipants checked "adequate knowledge" was Item '7 (of fering suggestions to> ' 
teachers for implementing career education activities) . One. person did 'not 



Table 5 



CAREER" EDUCATION FESTIVAL 
PRE--CONFERENCE/POST-CONFERENCE ASSESSMENT 
KNOWLEDGE OF GOALS 



Pre~conf erence 
Knowledge 
(n-17) 
Adequate Inadequate 



Pos t-conf erence 
Knowledge 
(n=9) 

Adequate Inadequate 



Missing 



1. Adequately define Career 
Education. . 



15 . 



2. Design appropriate learning 
experiences for career 
education activities. 



12 



3.. Use the Dictionary of 

Occupational Titles as a 
reference to identify jobs. 

Offer suggestions to 
teachers for implementing 
career education activities. 



11 



13 



5. Identify the 15 

Occupational Clusters 
. , defined *by U.S.O.E. 



6. Compile a resource file 
of persons who might be 
: willing to share an 
occupia tional experience. 



13 



7. Assist in designing hands on 
activities which involve the 
student directly in learning 
experiences. , 



12 



8. Know where Career Education 
projects are in operation 
, in Tennessee. 



10 



Aware of current literature 
and attitudes about the 
changing role of women and 
men in the work force and 
the home. ^ . . 



13 



LO.<-''Assist in designing values 

classification activities for 
.students based' on the 
premise that individuals • 
differ in their interests, 
abilities, attitudes and 
^ >alues • 
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Table '6 
CAREER EDUCATION FESTIVAL 
PRE-CONFKRENCE/POST-CONFERENCE ASSESSMENT 
RESPONSES BY POSITION OF RESPONDENT ' 







Number - 
indj eating 
^inadequacy 


N umbo r i n d if a t i n g 


PRE TEST 
inadoquat:e knowled^^e by Item" 
r ' I Leiu 




•^Number 


i ■■! 2 ! 3 


4 


i 5 


6 . /. 

' i ' 




1 9 


■10 


Teacher 


3 


3 


^ ^; — 

, 2 ; 


*> 




♦ - - ■ • — 


T ■ 

! . 


1 . 


Counselor 


3 


•. 3 


1-1 ; 1 : 

1 1 


1 






j 


1 ■ 
i 1 


1 


Project Director 


3 


1 


' 1 ; 1 j 

1 ^ 




I. 


■ t 


r 


i . 


— - 


State Department 
' Employee 


3 


1 


i '; 

i ' 1 


1 1 




1 . 


f 


'Advisory Council 


2 


1 


\ \ 1 

\ — ~ 










Higher Education 


1 


1 


1 ; 

1 


1 




1 1- 

t i 

' i 1" 


1 


1 


1- 


County Representative 


1 


1 




1 


1 




^ 1' 


Local Educational 
Agency 


1 


1. 


1 1 ' 


1 




1 






TOTAL. ■ 


17 


12 

— ^ 


2 - 5' 6 


— ; 
1 

4 


5 


4 5 


— 

10 

1 


.4 


4 



Teacher 



Counselors 



Advisory, Council 



County Representative 



! Number 
j indicating 
Number • inadequacy 



POST-^TEST 

Number indicating inadequate knowledge by item 

ITEM 



i .1 



7, j 8 



10 



State Department 
Employee 

TOTAL 



3 i 0 



1 \ 



I : .2 



.0 
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respond to Item 1 (adequately define career education), but all eight who did 
respond felt they had adequate knowledge. One-third (3 of 9) still felt in- 
adequate in using the Dictionary of Occupational Titles as a reference to., 
identify jobs: (Item 3), so that the percentage of those who felt a need in 
this respect remained about the same at the end as at' the beginning of the 
conference. 

Of those who completed both Pre- and Post-conference Assessments and ^ 
indicated feelings of inadequacy on one or more items. on the Pre-assessment , 
•62 percent' expressed feelings of adequacy on the Post^assessment (See Table 7) 



Table 7 ^ . * 

PARTICIPANTS' CHANGE AND LACK OF CHANGE DURING' CAREER; EDUCATION FESTIVAL 



Item 



Pre-conf erence Inadequate- 
Post-conf erence Adequate 



Pre-conf erence Inadequate- 
Post-conf erencfe Inadequate 



1 
2 
3 
4 
5 
6 
. 7 
.8 
. 9 
10 

N=9 



TOTAL 



0 


0 


2. 


1 


2 


■" ' 3 


2 • 


0 


2 


' 1 


0 


3 - 


0 . 


1' 


6 


' 0 


1 . 


0 


1 


1 


16 


1 

10 
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Use of a binomials test for significance shows that, the overall difference is 
not significant if . the probability of changewere' 0 = .50, p =M587). It 
should be noted, hicJwever, that all six participants who chicked Item 8 as ^ 
"inadequate" before the Festival gained competence. In contrast ; none of ;. the 



three who v checked Item' 6 asu 

poitit of feeling "adequate". 

• •• ' \ ■ . • 

V 



'inadequate" improved during the Festival' to the 



There is no way to determine which (or* how many) Festival activities^ 
were attended by each of .the participants. Therefore, what" each learned 
or .failed to laarn may be due, in part, to their own selection of activi- 
ties at the Festival. . " 

The assessment instrument itself contained some items which- related 
to specific knowledge and information,,, such ais the\use of the Dictionary 
of Occupational Titles (Item 3), identifying the. 15 occupational clusters 
(Item 5), knowing where career education projects were in Tennessee (Item 
8), awareness of current literature and attitudes about the changing role 
of women and men in the work force- and the home (Item 9). Other items 
represented knowledge of a "how to'V nature: . ded^ign appropriate learning 
experiences for* career education activities (lt,4m 2) , offer suggestions 
to teachers for implementing career education activities (Item 4), com- 
pile a resource file of persons who might be willing to share an occupa- 
tional experience (Item 6), assist in designing hands-on activities which 
involve the student directly in learning experiences (Item 7), assist in 
designing values classification (sic) activit|ies for students based on the 
premise that individuals differ in their interests ,' abilities , attitudes 
and values (Item 10). , / 

The relatively small number of people who completed the assessment 
instrument weakened the impact of any information derived from it. A' pre- 
test/post-test design can be useful in det)4rmining the effectiveness of a 
program if it can be determined that the instrument measures changes which 
are likely to occur because of the program. With respect to two of the 
items (3 and 6), there might be some ique&tion as to the appropriateness of 
including them in the instrument since hdped-for changes did not occur in 
thevpercentages of people who felt knowledgeable in regard to them. ; There 
should be ^correspondence between items on the evaluation instrument , and 
stated objectives. Overall, the post-test results were positive, however , 
many of those attending felt adequate before the conferencd. 

The assessmtot forms were distr;ib'uted durin^^ the first session, and at 
registration. There was n'o control river when participants completed the 
forms, however, so it is possible that data coded as "Pre-conf erence" or 
-"Posf-copference** may have been marked at the same^time/ In addition, 
participants who submitted both Pre- and ; Post^conf erence data did so on, 
the same form. . ' . . 

In light of these facts, any evidence of change obtained on this in- 
strument is questionably ^ince it cannot ^be determined when "Pre-Confer- 

ence"c and "Post-conference" 'Assessments were done by the individuals. 

.-' - ■ ■ ' ' . . ' ' ■ ■ . ' 

General ''Session Speaker 3 .... 

. t ■ ■ . ' ■ ..: ■■ ^ » . ' ^ ■ 

'CA total of 20 participants rated one or more of the four .general ses- 
^<^sions at ,the Career Educat-ion Festival. , Included among the 20 were four 
- cguhselors, two l:(^achers, two advisory council members, -three local educa— ^ 
..tlon agency stc'i ff memj^nr«, one project director, one state department 
employee, onc^ I. ibrarian , and one cquuty representative (see Table H) . . The 
four'-generil session programs included: an address by Dr. Sairi Betance^ on. 
•the opening day, banquet . speaker Dr. Sidney High, a panel discussion on the 
f inal* day niode rated by Carol Thigpen, and luncheon speaker Dr. Edwgrd C. Mann 
Kvaliiatioris of the four programs .-were completed by 19, 17, 16, and 14 people, 
respectively (se^ Table 9). Each program was' evaluated individually on six 
itejns', aitd al.Lv four .program evaluations were listed on a single form. . 



There were no negative ratings of Dr. Betances' presentation.. Dr. Mann's 
address was not rated as positively, particularly with respect to Items A and 
5 ("i; was stimulated to think about the topic presented" and "The session met 
my expectations.") | Unsolicited comments indicated Dr. Mann's speech was thought 
to be too long, applicable for those not already knowledgeable, and \that he 
lacked knov?ledge of| his audience. 

Dr. High's banquet address was rated lower than Dr. Mann's on the same two 
items (A and 5) , although Tjoth speakeris were seen as well informed on- the sub- 
ject (Item 3) and the content they presented was applicable to the development 
of career education (Item 6). 

The panel discussion was rated positively, with the lowest mean being that 
of 4.0, which corresponds to "Agree" on the 5-point scale that was used. 
• A concluding comment by one participant stated that "most speakers con- 
tributed no new ideas, just a rehashing of ideas and information which ±s common 
knowledge among thos^^ of us involved in career education." 

General reactions to the main speakers were positive, however the small 
number of completed evaluations is consistent with the other evaluation results 
from the Festival. • ^ • " • ' 

Mini Sessions 

Reports .on 19 of the 20 projects were presented during ' each of two dif- 
ferent 30-minute time periods on Wednesday ,• July l6. Evaluation forms were 
provided so that those attending could complete a rating fprm for each mini , 

session attended. ' • j , c u j' 

Seven of the 19 projects submitted no rating forms for either ot the^r 
two sessions, three projects submitted one form, and three other projects sub- 
mittea™ forms (see Table 10). Of the 19 projects participaiiing, only three 
submitted a total of ten or more rating forms for both sessions\ (Projects 12, 
13, and 15). An additional three project, directors turned. in fiy^ or seven 
forms each (Projects 3, A, and 8). " \ 

In general, the ratings given the mini sessions were favorably (see 
Table 10). Items 6 and 11 were worded so that; -a favorable rating was indi- 
cated by "Strongly Disagree" while all other items were .favorable if\the par- 
ticipants /agreed with the items. The highest percentage of disagreement or. • 
unfavorable sentiment occurred on Item 9 (This session met my expectations) , 
but even^ in this case," only nine percent of the. participants indicated un- 
favorable reactions to the sessions. ; . \ 

Responses on the rating forms indicated that the .presenters were rela- 
tively successful with respect to the.lA evaluation items (See Table 11). 
However, the low number of forms submitted, leaves soAe question as to the \ 
extent to which the respondents represented the diversity of the group of 
paftf'icipants who attended the sessions. The number of ratings probably is ^ 
primarily" a measure- of the conscientiousness of the presenter in encouraging \ 
people to turn them in- and bears little- relationship to actual attendance. .. 
^. -In general,' results of the evaluations carried out for the Festival were > 
positive. There seems lititle doubt that it. was a positive, constructive ex- 
pedience for those who participated. Hbwever, while various specific aspects 
of the Festival were targeted for evaluation as well as the overall project,. 
tL same low response rkte characterizes all three evaluation efforts. It is 
^fortunate that the time and effort spent in planning .the evaluation and .pre- 
/{jaring the forms did not produce enough data upon which to forpulate con- 
/clusions which could be considered_represent;.ative of the group' 



The 'collect ion of evaluation., data '^needs to be more systematic, and 
evaluation instruments must be designed in light of stated objectives. If 
a pre-test /post-test instrument is to be used, care must be exercised to 
insure that data are . collected at the appropriate times. 

Information from the State Coordinator indicate that all but one of 
the funded projects (95%) attended the conference • This considerably ex- 
ceeded the 65% target established in Sub goal Bl. The Career Education^ 
Festival, or a similar event, seems to hav^ great potential fox providing 
a stimulus for career education in Tennessee if more people, particularly 
those not already Involved in funded projects, could be reached. Comments 
from participants indicated that presentations were good* and would have 
been helpful for others, but those involved' in funded' projects wore rela4 
tiv'ely well acquainted with the topics presented. . 
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Table 8 = 
GENERAL , SESSION SPEAKERS 
Participants Completing Evaluation Forms 



Counselors. '4 

Local Educational Agency Staff. . 3 

Project D-irector 1 

. State Department Employee . . . . 1 

Librarian . 1 

Advisory Council Member 2 

Teacher 2 

County Representative . . . ........ i ... . 1 

Unknown ........... 4 



TOTAL 19 
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TAHLE 9 
CAREER EDUCATION FESTIVAL.* 

Genera! Session Evaluations 



JULY 15, 1^J8() 
MAIN ADDREsK 
DR. SAM BETANCES 

. ■ A 



j Strongly 
Agree 
(5) 



Strongly Mean* 



1. The objectives of ' 
the session were 
clear. 



The purposes of ^ 
the session were 
realistic^ 



Agree 
(4) 



.Undecided 
(3) 



14 



17 



Disagree ; Disagree 
(2) i ! (1) 



4.74 



4.90 



The presenter wds 
wfell informed on 
the subject. 



I was stimulated 
;to think, about the 
topic presented. 



' 18 



17 



4.90 



4.89 



5. The session met 
f my exii>ec tat ions . 



6. The content 
presented' was 
applicable to the 
development of 
career education. 



T 



= 19 



17 



17 



4.84 



. ...4.84 



High mean (near 5). indicates favorable rating. 
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Gei\erai Session Evaluations (continued) 



[!• '^'JULY 16,^980 ' 

. BANQUETr MAIN ADDRESS 
DRV SIDNEY HIGH , • 



4; I was stimulated 
1 to think about 
th'e topic 
presented - 



'2 



5. The ses'sipri met. 
my eacgectatioris.^ 



6. The content . 
presented was 
applicable to the 
o development of - . 
career (education. 



3 



,3.06 



2.47 



4.25 
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Strongly 
Agree 
• (5) 


Agree i Undecided 
(4). i \(3) 


Disagree .. 
(2) 


Stronelv 
Disagree 

(1) 


Mean* , 


Ir . Tl>e objectives of. 
the session were 
■ clear. 


• 

6 , 


■ \ - -\ - 
8 2 
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, ■ 1 
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■ 

A. 12 


, . ■ u \ 

27 The purposes of ^ 
t^he session were - 
realistic. o 


t ■ ! 

"1 • ■ ^ ' 
1 ; 
• 5 ■ 1 8 3 ■ 


1 




4.0 


"j ' ^ 

3. The presenter was 

weJLi informed \ . ■ . 
i-' on the subjects 


10 


■ ■ . ] 

j ■ 

7 • , . 




- i 

4.59 1 

— — — ^ — —4 



N =17 , 

* High mean (near^5) indicates favoraBle rating. 
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Geneml Session Eva liuit ions (continued) 

.11. JULY 17, 1980 - 
PANEL DISCUSSION * 
: CAROL THIGPEN, MODERATOR . 
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- 1 


Strongly 
Agree 
(5) 


Agree 
(4) 


■ ' \ Strongly 
Undecided Disagrae Disagree 
(3) ■ (2)1 (1) 


. Mean* 




,The objectives 'of 
1 the session were 
clear. 


' 9 


7 . ' 




4,56 • 


2. 

' \ 


The purposes of 
the session were 
realistic. 


8 


7 


1 ' ■ ■ . _ 


4.44 


. - " 3. 


The panel members 
were well informed 








4.63 




oTi— the sub^-ect .-^ - 


r 11 - - - 


-—4- — " 




4. 


I' was ^imulate'd 
- to ^ think about . t[he ^ 
topic presented. 


6 


...8 ; 


2 .. 


.4,13 ; 


■ . 5. 


The session met 
" my expectations. 


3 


. 11 


' 1 ■ 1 ■.; . 


4.0 ' 



; ' 6. The 'content .'^ ■ ^ . 

presented was . ^ ^ j 

» applicable to .the . . /' - , ^ ' 

.- development of - r~. " ~ 

. , career education. , 8 -\ 8 - V 



N = 16 

* ■ ■ • *• « . 

: '* High mean (near- 5) indicntes .nivorable rating. 
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General Session Evaluations (continued) 



tV. JULY 17, 1980 
LUNCHEON • 
' DR. EDWARD C. MANN 
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,j Strongly 
. ' Agree 
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Undecided 
(3) . 
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Strongly 
Disagree 
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the session was 
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The purpose of the 
session were 
realjistic. 
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4.14 , 
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The presenter 
was well informed 
on the subject. 
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to think about 
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the topic presented. 



The session met 
my expectations . 



3.54 



3.57 



The content 
•presented was 
applicable to the 
development of 
career educa t ion . 



N = 14 ' 

* High mean- (^ear 5) indicates favbrable rating. 
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■ i-n^ir>"'W*'^"y^^P» list of proj^ctfl, 
:;' " Nuniber^'of completed rat Iur forms. • 



TABLE 11 
CAREER EDUCATION FESTIVAL 
MINI-SESSION RATINGS 
(OVERALL PER:CENTAGES) 
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*. Strongly disAgree^ is favorable response, 

Qi" See preceding page for items corresponding to item numbers, 
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1. Alcoa/Maryvi llc/lUounL. 

2. Anderson 

3. Claiborne 

4. /Cleveland 

5 . Greeneville . 

6. Humboldt 

(» 

7. Huntington 

8. Knoxville 

9. Nashville 
.10. Oak Ridge 
11/ ^ Overton / 

12. Putnam 

13. ■ Rhea,. 
I'A. . Scott 

15. v.Sherby 

16. South Carroll • 
17,. Trenton ' - 

18 1 Washington. 
19. Wayne ^ • , 
; 20 . Wilson /Lebanon/Wat^rtown 
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SECTION 8 

FINAL REPORTS FROM LOCAL PROJECTS .. ' , " 

Identification of Projects • 
• , ■ ■. ■ ■ . ' 

Twenty local projects were funded in Tennessee under provisions o"f the • 
Career Education Incentive Act (PL95-207) . The participating school systems . •. 
were: . . ' . ^ ' ' ^ - , 

1. jAlcoa/Haryville/Blount County 

2. Anderson County . 

3. Claiborne County^ - . 

4. Cleveland " ' ' r " ' 
5.. Greeneville City Schools - 

6. Humboldt • • . . . . •: 

7. Huntingdon * 

8. ^ Knoxville City Schools " • . 

9. Metro Nashville/Davidson County . ^ , , ' 

10. Oak Ridge City Schools \ , ^ . 

• 11. .Pverton County ' ' ^ 

.12. Putnkm. .-County . ' , 

13. Rhea County 
- -14. Scott County ' 

15. Shelby County • . ■ 

16. South Carroll 

17.. Trenton - 
I8p Washington County - . 

19. Wayne County ' - 

20. Wilson/Lebanon/Watertovm ' 

* A complete final project report consisted of a structured checklist, 
a narrative section, and a financial report., All 20 project directors sub- 
mitted' a financial report, 17. submitted the checklist , and 17 provided the 
narrative section. While Project 5 did not include the checklist, and Pro j- . 
ect 19 did not contain a" narrative section, in some cases it was possible to 
infer responses for one section from tho^se included in the other. Thus many 
of the findings in the- paragraphs which, follow were based on data from 18 of 
20 local proje(;,ts. 

. , Prior^Needs Assessment D.ata ^ , 

As part of the proposal submitted for the funding competition each local 
education I agency was asked to provide, data from a prior neefls assessment which 
could be used as the basis for local project objectives . One-third of the 18 
, project proposals reviewed contained no, objetitive needs assessment data, just 
the* proposal writer '^s/ opinions about local needs. , ' . 

Thp dozen project*^ proposals which did show evidence of data ^collection 
for • the purpose* of/establishing need employed a variety of need.-; assessment 
strategies: . / " ' . ' • . ^ 

. heeds assessment surveys of students and school staff , ^parents, 

and community representatives ' - 
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. needs identification and priority-setting by school b.oard or local 

career education advisory council 
• calculation of dropout or suspension rate v ^/ 

. follow-up surveys of ^high School graduates " / 

. pretests, of career education knowledge and attitudes for school .^'^ 

staff 

. state proficiency test scores 

Eleven, of the 12 proposals citing objective needs assessment data focused 
first on the needs of students. Student needs most often identified included 
information designed to*: . • i 

. increase self-understanding 

. acquaint students/with the vast variety of caree^rs available 
..increase appreciation for the value of work, the interdependency 
' of jobs 

. increase awareness of the relationship between, basic skills and. ^ 

/their application in the world of work 
./improve use of leisure time <. ' 

. .1 enhance decision-making skills 

.1 impart job-iseeking skills . • . 

i increase participation in part time employment. 

/in order to provide for the student needs, seven proposals contained the 
suggestion that the school curriculum be infused with career education concepts^ 
In otder to prepare "staff properly to perform infusion, staff development and 
career education materials were neededV These two basic needs identified by 
local proposal developers in 1979 were the same as. those identified more than 
a year earlier by tlie evaluation director in her State-wide career education 
needs assessment. 

:>.^^'' 'Proje<!it Organization.' and Support 

Eight of Tennessee *s local career education projects employed a career . 
education coordinator on a full-time or part-time basis (see Table 12). Six- 
teen of 17 reports indicated that= a local advisory council had been established 
to give assistance and direction to the project. The councils consisted of 
from 7 to 33 members, with an average membership of 18^ (see Table 13). Groups 
.most frequently represented on 'the advisory councils were business and indus- 
trial representatives and parents (15 projects each), educators .(14 projects), 
and labor '(11 projects). 

Fourteen of the reports listed a total of 382 groups which had cooperated 
with* the school sy stein in implementing or maintaining, career education efforts 
(see Table 14). Part of this 'large -total was due to the listing provided by 
Project 2, .which included ^approximately 200 cp~op businesses. In addition to 
this one large listing, 60 business, and* industrial ' groups , 48-govemment agen- 
cies, 27 civic groups, 25 educational institutions (public and private) and 22 
^professional . organizations^ were involved in career education across Tennessee " 
during 1979-80. .Project 3 did not cite specif ic ^groups but reported coopera^ 
tion from the total cQmrnunlty.' . The actual numbers • of ..persons involved could 
not be calculated since one group might have included many individuals repre- 
senting different organizations'; It is noteworthy that only three projects 
that completed the report repbrted^ no community involvement. \ . " 
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TABLE l\. CAREER EDUCATIOf ADVISORY COMMITTEE COMPOSITION 
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tABLE 14. ' types" MD NUMBERS OF GROUPS COOPERATING WITH THE SCHOOL SYSTEM 
IN IMPLEMENTING OR MAINTAINING CAREER EDUCATION EFFORTS 
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■ ' Need5? Assessments Conducted During 1979-80 

Sixteen projects reported" conducting one or more needs assessments during 
1979-80 (see Table ;15). The grouj^s most often surveyed were counselors (16 
pifOjects), teacher)^ and administrators (15 projects each), others (9 projects), 
students (7 pro.j.eats), and parents (5 projects). Consistent with th6 conclu- 
sion reached' in prior needs assessments that /^staff development was a crucial 
piferequisite for meeting student needs, more concern was shown in 1979-8*0 for 
detern)ining staff ..needs than stuclent nefeds. 

Total numbers of needs assessments "conducted and persons providing the 
data were.npt calculated because there appeared to be some confusion among 
project directors about (1) the 'definition of needs assessment, and (2) the 
way . to report numbers. Two project' directors reported that they had conducted 
more than vlOO needs assessments ; one project report included percentages .rather 
than numbers of persons providing information. 

.<v Staff Development 

All 17 projects for which final checklists were provided ' included evidence 
that career education inservice training activities had been conducted . A -total 
of 3,953 educators participated in these activities ■ (see Table 16). The career, 
education topic most frequently addressed in the inservice-^ activities was- under- 
standing the nature and goals ^of career education, which was presented in all 17 
projects (s'ee Table 17). Developing a. career education plan , developing compe- . 
tence to infuse career education into the curriculum, and learning ways to as- 
sist students in broadening career goals each were topics for 16 projects. 
Designing methods to overcome stereotyping/bias in career education (15 projects 
and acquainting participants with changing work patterns of men and women (14* 
projects) were also discussed by most projects. All 17 projects had conducted - 
inservice presentations which would acquaint their personnel ' with career educa- 
tion concepts and better equip them to develop and implement career ■ education 
programs in their respective systems consistent with their unique .program goals. 

Evidence tlfiat the insejvice programs and other staff development activities 
did encourage teachers 'to oehgage in' career activities and infusion methodology 
was shown in 16 projects. More than 1,611 cla3sroDms were involved in career 
education infusion activities ■: (see Table 18). This represents an average of • 

*over%15 classrooms per' project for the l4^,projects detailing -numbers of class- 
rooms. In addition, 'one project indicated that infusion occurred in' two 'pilot 
schools at each grade level but did not specify the number of classrooms in- * 
volved, while another project report did not give figures but stated* that the 
plan was being implemented. / • . ' - , . 

Curriculum guides were' developed by:: -three projects (4, 9, and 15), as means 
of facilitatirig the' infusion process. - If the classrooms contained an average ^ 
of 25 students, the estimated number of students being* reached by the infusion 
process during 1979-80 would be approxii^ately 40,275 for the, 14 projects sup- 
plying data. In view of the lack of. specific data from some projects, this 
must be considered a, conservative figure. 

Some projects devoted 1979-80 -.career education efforts primarily to pre- 
liminary' activities' such as needs assessment procurement and organization of 
materials, and development of a' plan" rather' than implementation i ■ Others 
focuseS on a pilot group to develop quality programs before extending their 

^efforts to others in their respective systems. The. number of classrooms a;f- 
fected would, therefore, be expected to grow in subsequent years as more pro j- - 

-ects become fully inyolved in infusion. . The large number 'of classrooms in 
which career educatibn infusion activities were being conducted dutirig 1979-80 
casts a very positivife reflection of\ the leadership^ shown iat both Sta-te and 
locals levels . 
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